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PROPOSED AMENDMENT AND 
RESPONSE FOR INTERVIEW 
PURPOSES ONLY 



Fax To: Examiner Ceasar Paula 
Fax#; 571 273 4128 

Re: Proposed Amendment and Response and Interview Agenda for 

Application Serial # 10,608,267 



Dear Examiner Paula, 

The attached Proposed Amendment and Response is being faxed to you for interview 
purposes only. As I indicated in my voicemail to you yesterday, I am hoping we can 
have an in-person interview next week Thursday (1 1.30 am or 1 .00 pm) or if that does 
not work for you a telephonic interview Monday or Tuesday. I will call you today to 
follow up on scheduling the interview. 
Kind Regards, 



Carl K, Turk 

Merchant & Gould, PC 
404 954 5048 

cturk@merchantgould.com 
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LEVERAGING MARKUP LANGUAGE DATA FOR SEMANTICALLY 
LABELING TEXT STRINGS AND DATA AND FOR PROVIDING 
ACTIONS BASED ON SEMANTICALLY LABELED TEXT STRINGS AND 
DATA 



Mail Stop Amendment 
Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

AMENDMENT AND REPSONSE 

Dear Sir: 

The present communication is in response to the Final Office Action mailed on 
September 27, 2007. Entry of the following amendments and remarks is respectfully requested 
as follows: 



Amendments to the Claims are reflected in the listing of claims which begin on page 2 of this 
paper. 

Remarks begin on page 10 of this paper. 



I 
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Amendments to the Claims 

1. (Cancelled) 

2. (Currently Amended) The method of Claim 3, wherein determining, in the action 
plug-ins, one or more actions based on the markup language data comprises: 

for each markup language element of the markup language data, parsing a 
namespace library for equivalent markup language elements that include the one or more labels : 

obtaining one or more actions associated with the equivalent markup language 
elements for displaying with the plurality of actions received from the plurality of action plug- 
ins. 

3. (Currently Amended) A computer-readable medium which stores a set of 
instructions which when executed performs a method for creating, editing and/or viewing an 
electronic document, actions on a string of text or data in the electronic document, the method 
comprising: 

receiving a text string that includes at least one annotated portion and at least one 
unannotated portion with markup language data in a recognizer dynamic link library (DLL); 

parsing markup language data associated with the at least one annotated portion to 
assist the recognizer DLL to determine one or more labels for the at least one unannotated 
portion of the text string[[;]] by: 

comparing the elements of the markup language data with a plurality of 
stored markup language elements associated with stored labels to determine a match: and 

if a one or more markup language elements matches one or more stored 
markup language elements associated with stored labels, then labeling the text string with 
the associated stored label of the matched one or more markup language elements: 

transmitting the text string* end the markup language data , and the one or more 
labels associated with at the least one annotated and the at least one unannotated portions to a 
plurality of action plug-ins , wherein the action plug-ins are determined based on the one or more 
labels : 

determining, in the action plug-ins, one or more actions based on the markup 
language data and the one or more labels : 
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passing the one or more actions to an application program module for displaying 
the one or more actions in association with the text string; and 

displaying the one or more actions in association with the text string. 

4. (Cancelled) 

5. (Currently Amended) The method of Claim 3, wherein th e st e p of parsing the text 
string the markup language data to determine one or more labels comprises: 

comparing the text string with a plurality of stored text string with an associated 
stored label to determine a match; and 

if a the text string matches a stored text string with an associated label, then 
labeling the text string with the associated stored label of the matched stored text string[[;]] . 

comparing th e e l e ments of th e markup language data associated with th e t e xt 
string with a plurality of st o r e d markup languag e e l e ments as s ooiat e d - with associated s tor e d 
labels to det e rmine a mateh; and 

if - a on e or more markup language e lements as s ociated with the text s tring 
matohoo one or more stored markup language elements with associated stor e d labels, then 
lab e ling th e t e xt s tring with th e- as s ociat e d stor e d lab e l of th e match e d on e or more markup 
languag e e l e m e nts. 

6. (Cancelled) 

7. (Previously Presented) The method of Claim 3, further comprising modifying the 
content of an electronic document to reflect the one or more labels. 

8. (Previously Presented) The method of Claim 7, further comprising: 

causing the application program module to fire an event within an object model of 
the application program module; 

causing software instructions associated with the event to be executed when at 
least one of the plurality of labels is determined. 
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9. (Previously Presented) The method of Claim 3, further comprising examining the 
content of the electronic document surrounding the text string to aid in parsing the text string to 
determine a plurality of labels. 

10. (Cancelled) 

1 1 . (Currently Amended) A method for labeling a string of text in an electronic 
document as the electronic document is created in an application program module, the method 
comprising: 

as a string of text having an associated one or more Extensible Markup Language 
(XML) elements is entered into the electronic document, determining whether the string of text 
matches one of a plurality of stored strings; 

if so, then designating a label associated with the matched stored string for 
application to the entered string of tex t, wherein the label is to be transmitted to one or more 
action plug-ins for determining a set actions associated with the string of text, and wherein the 
action plug-ins to receive the label are also determined based on the label ; 

if the string of text does not match one of a plurality of stored strings, determining 
whether the one or more XML elements associated with the string of text is associated with a 
label for use with the entered string of text utilizing at least one label associated with another 
string in the electronic document; aad 

if so, then designating a label associated with the one or more XML elements for 
application to the entered string of text; 

displaying an indication indicating that the label has been found for the string of 

text . 

12. (Currently Amended) The method of Claim 11, further comprising: 

if a label associated with the matched stored string is designated for application to 
the entered string of text, determining [[a]] the set of actions associated with the label associated 
with the matched stored string; and 

if a label associated with the one or more XML elements is designated for 
application to the entered string of text, determining [[a]] the set of actions associated with the 
label associated with the one or more XML elements. 
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13. (Original) The method of Claim 12, whereby determining a set of actions associated 
with the label associated with the one or more XML elements, further comprises: 

for each label associated with the one or more XML elements, parsing a 
namespace library for equivalent markup language elements; 

obtaining zero or more actions associated with the equivalent XML elements for 
combining with the set of actions associated with the label associated with the matched stored 
string. 

14. (Cancelled) 

15. (Currently Amended) The method of Claim 1 3, further comprising the s tep s of : 

determining that a user has selected the string of text; and 

in response, displaying the combined set of actions to the user. 

16. (Currently Amended) The method of Claim 15, further comprising th e s teps of : 

receiving an indication that one of the plurality of actions has been selected; and 
in response to receiving an indication that one of the plurality of actions has been 
selected, then causing the application program module to execute the selected action. 

17. (Previously Presented) The method of claim 11, further comprising: 

determining whether the one or more XML elements associated with the string of 
text is associated with a label for use with the entered string of text based on a label associated 
with another string of text adjacent to the string of text. 

1 8. (Currently Amended) The method recited in Claim 16, wherein the application 
program module executes the selected action by determining whether an action plug-in among 
the one or more action plug-ins in an action dynamically linked library assigned to the action is 
available; and 

if so, then receiving instructions from the action dynamically linked library 
assigned to the selected action. 
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19. (Currently Amended) The method recited in Claim 1 8, further comprising the 
step s of : 

if an action plug-in dynamic link library is not available, then using a Uniform 
Resource Locator assigned to the action to navigate to a Web site and download the action plug- 
in dynamic link library. 

20. (Cancelled) 

21 . (Currently Amended) A system for providing helpful actions on a string of text in 
an electronic document as the string is entered into the electronic document, the system 
comprising: 

a memory storage; and 

a processing unit coupled to the memory storage, wherein the processing unit is 
configured to execute: 

an application program module for creating the electronic document; 

an action dynamically linked library connected to the application program 
module operative to provide one or more actions associated with one or more markup language 
elements applied to the string of text; 

a namespace library associated with the application program module for 
providing one or more equivalent markup language elements that have been designated as 
equivalent to the one or more markup language elements applied to the string of text in the 
electronic document; 

at least one recognizer dynamically linked library for providing semantic 
labeling to one or more portions of the string of text based on the one or more markup language 
elements applied to the string of text and based on one or more markup language elements 
associated with other strings of text in the electronic documen t wherein the at least one 
recognizer dynamically linked library is operative 

to receive the string of text. 

to receive the one or more markup language elements applied to 
the string of text in the recognizer dynamically linked library. 
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to transmit the string of text and associated markup language 
elements to a plurality of recognizer plug-ins based on the semantic labels, and 

wherein the action dynamically linked library is further operative to 
provide additional one or more actions associated with the one or more equivalent markup 
language elements. 

22, (Currently Amended) The system of Claim 21 , wherein 

th e r o oogniz e r dynamically link e d library is op e rativ e 
to receiv e th e string of t e xt; 

to roo o ivo the on e or mor e markup languag e el e m e nts appli e d to th e string 
of t e xt in the recognizer dynamically linked library; 

to transmit the string of t e xt and associated markup languag e e lem e nts to a 
plurality of rooogniz e r plug ins; 

the plurality of recognizer plug-ins being operative 

to parse the string of text to determine a plurality of labels; 

to parse the associated markup language elements to assist each of the 
plurality of recognizer plug-ins to determine a plurality of labels for the string of text; 

to transmit the plurality of labels to the recognizer dynamically linked 

library; and 

the recognizer dynamically linked library being further operative to transmit the 
plurality of labels and the associated markup language data to the application program module. 

23, (Previously Presented) The system of Claim 22, 

wherein recognizer dynamically linked library is further operative prior to 
transmitting the plurality of labels from the recognizer plug-ins to the recognizer dynamically 
linked library, to transmit the string of text, the associated markup language elements and the 
plurality of labels back to the plurality of recognizer plug-ins; and 

the plurality of recognizer plug-ins being further operative to parse the string of 
text, the associated markup language elements and the plurality of labels to determine a plurality 
of labels for the string of text not previously determined for the string of text. 
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24. (Previously Presented) The method of claim 17, wherein the label associated with the 
string of text is an "address" label and the label associated with the other string of text is a "ZIP 
code" label 
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Remarks 

In response to the Final Office Action mailed on September 27, 2007, the Applicants 
sincerely request reconsideration and reexamination of the current application in view of the 
above amendments to the claims and the following remarks. The response is being submitted 
along with a Request for Continued Examination. The claims as presented are believed to be in 
allowable condition. 

Claims 2-5, 7-19 and 21-24 are currently pending in the present application, and have 
also been rejected. Claims 2, 3, 5, 1 1, 12, 15, 16, 18, 19, 21, and 22 have been amended. Claims 
4, 10, and 14 are cancelled without prejudice or disclaimer. No new matter is added by the 
amendments. 

Information Disclosure Statement 

The Office Action states that IDSs filed on 6/22/2007 and 7/30/2007 have not been 
considered, because the listed entries are illegible. Clean copies of the referenced IDSs have 
been faxed to the Examiner and their receipt confirmed through a phone call on October 9, 2007. 
The Examiner is respectfully requested to indicate any IDSs that may not have been considered 
due to illegibility or other reason. 

Interview Summary 

An interview was held between the Examiner and the Applicants' attorney on . 

THIS SECTION TO BE COMPLETED AFTER THE INTERVIEW 

Claim Rejections Under 35 U.S.C. £ 103 

Claims 2-5, 7-19, and 21-24 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Hyunh et a/., hereinafter Huynh, (U.S. Publication No. 2002/0198909, 12/26/2002). 

Applicants respectfully submit that the cited reference, Huynh, was filed on June 27, 
2002 and published on December 26, 2002. Huynh reference is assigned to the same assignee 
(Microsoft Corp.) as the present application. The present application has a filing date of June 27, 
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2003. Thus, Huynh is a reference under 35 U.S.C. 102(e) cited for a 35 U.S.C. 103 rejection, 
and does not, therefore, preclude patentability under 35 U.S.C. 103(c). However, for the 
purposes of furthering prosecution, Applicants have amended pending claims as listed above and 
would like to have them reconsidered in light of the arguments below. 

Amended independent claim 3 recites a computer-readable medium which stores a set of 
instructions which when executed performs a method for creating, editing and/or viewing an 
electronic document, actions on a string of text or data in the electronic document, where the 
method includes, inter alia, "parsing markup language data associated with the at least one 
annotated portion to assist the recognizer DLL to determine one or more labels for the at least 
one unannotated portion of the text string by comparing the elements of the markup language 
data with a plurality of stored markup language elements associated with stored labels to 
determine a match; and if a one or more markup language elements matches one or more stored 
markup language elements associated with stored labels, then labeling the text string with the 
associated stored label of the matched one or more markup language elements", "transmitting the 
text string, the markup language data, and the one or more labels associated with at the least one 
annotated and the at least one unannotated portions to a plurality of action plug-ins, wherein the 
action plug-ins are determined based on the one or more labels", and "determining, in the action 
plug-ins, one or more actions based on the markup language data and the one or more labels." 

According to claim 3, markup language data associated with an annotated portion of a 
text string is parsed to assist the recognizer DLL to determine labels for an unannotated portion 
of the text string by comparing elements of the markup language data with stored markup 
language elements associated with stored labels and labeling the text string with stored labels of 
matching markup language elements. The text string, the markup language data, and the labels 
associated with the annotated as well as unannotated portions are transmitted to action-plug-ins 
based the labels and actions are determined in the action plug-ins based on the mark-up language 
data and the labels. 

Amended independent claim 1 1 recites a method for labeling a string of text in an 
electronic document as the electronic document is created in an application program module that 
includes, inter alia, "as a string of text having an associated one or more Extensible Markup 
Language (XML) elements is entered into the electronic document, determining whether the 

10 
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string of text matches one of a plurality of stored strings", "if so, then designating a label 
associated with the matched stored string for application to the entered string of text, wherein the 
label is to be transmitted to one or more action plug-ins for determining a set actions associated 
with the string of text, and wherein the action plug-ins to receive the label are also determined 
based on the label", and "if the string of text does not match one of a plurality of stored strings, 
determining whether the one or more XML elements associated with the string of text is 
associated with a label for use with the entered string of text utilizing at least one label associated 
with another string in the electronic document." 

Amended independent claim 21 recites a system for providing helpful actions on a string 
of text in an electronic document as the string is entered into the electronic document that 
includes, inter alia, "an action dynamically linked library connected to the application program 
module operative to provide one or more actions associated with one or more markup language 
elements applied to the string of text", "a namespace library associated with the application 
program module for providing one or more equivalent markup language elements that have been 
designated as equivalent to the one or more markup language elements applied to the string of 
text in the electronic document", and "at least one recognizer dynamically linked library for 
providing semantic labeling to one or more portions of the string of text based on the one or 
more markup language elements applied to the string of text and based on one or more markup 
language elements associated with other strings of text in the electronic document, , wherein the 
at least one recognizer dynamically linked library is operative to receive the string of text, to 
receive the one or more markup language elements applied to the string of text in the recognizer 
dynamically linked library, and to transmit the string of text and associated markup language 
elements to a plurality of recognizer plug-ins based on the semantic labels." 

Hyunh discloses a method and system for semantically labeling data, such as strings of 
text and media objects, during creation of an electronic document and providing a selection of 
actions that may be performed based on the semantically labeled data" (Huynh: Abstract, 
par. 10). Huynh further discloses "[w]hen an application program module receives a new string, 
such as when the user enters a new paragraph or cell value into an electronic document or edits a 
previously entered paragraph, the paragraph containing the new string is passed from the 
application program module to a recognizer DLL. During idle time, the paragraph is passed to 
the recognizer plug-ins. The recognizer plug-ins are executed on the paragraph to recognize 

11 
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keywords or perform other actions defined by the recognizer plug-in. As part of executing the 
recognizer plug-in, the paragraph or cell value may be broken into sentences by the recognizer 
plug-in. However, each recognizer plug-in is responsible for its own sentence-breaking." 
(Huynh: Par. 10, 11). 

Thus, elements of amended independent claims 3, 11, and 21 - such as parsing markup 
language data associated with an annotated portion of a text string to assist the recognizer DLL 
to determine labels for an unannotated portion of the text string by comparing elements of the 
markup language data with stored markup language elements associated with stored labels and 
labeling the text string with stored labels of matching markup language elements; transmitting 
the text string, the markup language data, and the labels associated with the annotated as well as 
unannotated portions to action-plug-ins based the labels; and determining actions in the action 
plug-ins based on the mark-up language data and the labels - are not taught or suggested by 
Hyunh or any of the heretofore cited references. Therefore, amended claims 3, 1 1, and 21 are in 
condition for allowance. Notice to that effect is respectfully requested. 

Claims 2, 5, 7-9 depend from claim 3; claims 12, 13, 15-19, and 24 depend from claim 
1 1 ; and claims 22-23 depend from claim 21 with additional features. Therefore, claims 2, 5, 7-9, 
12, 13, 15-19, 22-23, and 24 are allowable for at least the reasons discussed above for 
independent claims 3, 1 1, and 21. 
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CONCLUSION 



Applicants respectfully request that this Amendment be entered by the Examiner, 
placing the claims in condition for allowance. Applicants respectfully submit that the proposed 
amendments of the claims do not raise new issues or necessitate the undertaking of any 
additional search of the art by the Examiner, since all of the elements and their relationships 
claimed were either earlier claimed or inherent in the claims as examined. Therefore, this 
Amendment should allow for immediate allowance of all pending claims by the Examiner. 

Please grant any extensions of time required to enter this amendment and charge any 
additional required fees to our Deposit Account No. 1 3-2725. 



Respectfully submitted, 



MERCHANT & GOULD 



Date: 



2007 



Carl K. Turk 
Reg. No. 59,675 



Merchant & Gould, LLC 
P.O. Box 2903 

Minneapolis, Minnesota 55402-0903 
Telephone: 404.954.5100 



PATENT TRADEMARK OFFICE 



27488 
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